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Abstract 

Indirect reciprocity in which players cooperate with unacquainted other 
players having good reputations is a mechanism for cooperation in relatively 
large populations subjected to social dilemma situations. When the pop- 
ulation has group structure, as is often found in social networks, players 
in experiments are considered to show behavior that deviates from existing 
theoretical models of indirect reciprocity First, players often show ingroup 
favoritism (i.e., cooperation only within the group) rather than full cooper- 
ation (i.e., cooperation within and across groups), even though the latter is 
Pareto efficient. Second, in general, humans approximate out group members' 
personal characteristics, presumably including the reputation used for indi- 
rect reciprocity, by a single value attached to the group. Humans use such a 
stereotypic approximation, a phenomenon known as outgroup homogeneity 
in social psychology. I propose a model of indirect reciprocity in populations 
with group structure to examine the possibility of ingroup favoritism and 
full cooperation. In accordance with outgroup homogeneity, I assume that 
players approximate outgroup members' personal reputations by a single rep- 
utation value attached to the group. I show that ingroup favoritism and full 
cooperation are stable under different social norms (i.e., rules for assigning 
reputations) such that they do not coexist in a single model. If players are 
forced to consistently use the same social norm for assessing different types 
of interactions (i.e., ingroup versus outgroup interactions), only full coopera- 
tion survives. The discovered mechanism is distinct from any form of group 
selection. The results also suggest potential methods for reducing ingroup 
bias to shift the equilibrium from ingroup favoritism to full cooperation. 
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1. Introduction 



Humans and other animals often show cooperation in social dilemma situ- 
ations, in which defection apparently seems more lucrative than cooperation. 
A main mechanism governing cooperation in such situations is direct reci- 
procity, in which the same pair s of playe r s repeatedly interact to realize mu- 



tual cooperation (ITriversl . Il97ll ; lAxelrodl . 1 19841 ; iNowakl . l2006al ). In fact, indi- 



viduals who do not repeatedly interact also cooperate with others. In this sit 
uation, reputation-based indirect reciprocity, al so known as downstream red 



procity, is a viable mechanism for cooperation (INowak and Sigmundl. Il9 98a 



Leimar and Hamm ersteinl.l200ll;IOhtsuki and Iwasal . 120041 . 120071 ; INowak and Sigmund 



20051 ; iBrandt and Sigmundl . 120051 . 120061 ). In this mechanism, which I refer to 



as indirect reciprocity for simplicity, individuals carry their own reputation 
scores, which represent an evaluation of their past actions toward others. In- 
dividuals are motivated to cooperate to gain good reputations so that they 
are helped by others in the future or to reward (punish) good (bad) others. 
Indirect reciprocity facilitates cooperation in a larger population than in the 
case of direct reciprocity because unacquainted players can cooperate with 
each other. Although evidence of indirect recipr ocity is relatively scarce for 



nonhumans (but see iBshary and Grutterl (120061) ). it is wide l y acc epted as 



explanation for cooperation in humans (INowak and Sigmundl . 120051 ). 

Humans, in particular, belong to groups identified by traits, such as age, 
ethnicity, and culture. Individuals presumably interact more frequently with 
ingroup than outgroup members. Group structure has been a main topic of 
research in social ps ychology and sociology for many decade s (Brown, 2000; 



Dovidio et al.l . l2005l ) and in network science (IFortunatol . |2010| ) . Experimental 
evidence suggests that, when the population of players has group structure, 
two phenomena that are not captured by existing models of indirect reci- 



First, in group-structured populations, humans ( 


Sedikides et al.. 


1998: 


Brewer . 


1999; 


Hewstone et al.. 


2002 


Dovidio et al.. 


2005; 


Efferson et al. 


2008) 



and even insect larvae (ILize et all 120061 ) show various forms of ingroup fa 



voritism. In social dilemma games, individ uals behave more cooperatively to - 
ward ingroup than outgroup members (e.g..lDe Cremer and van Vugtl (119 99) ; 



Goette et all (120061) :lFowler and Kami ( 2007 ): iRand et all (120091) : lYamagishi et al. 
(Il998l . Il999i ): lYamagishi and Mifunel (12008^ . In group favoritism in social 



dilemma si tuations may occur as a resul t of indirect reciprocity confin ed in 
the group (lYamagishi et al.l . Il998l . Il999t lYamagishi and Mifunel . 120081 ). In 



contrast, ingroup favoritism in social dilemma games is not Pareto efficient 
because individuals would receive larger payoffs if they also cooperated across 
groups. Under what conditions are ingroup favoritism and intergroup coop- 
eration sustained by indirect reciprocity? Can they bistable? 

Ingroup favoritism, which has also been analyzed in the context of tag- 
based cooperation, the green beard effect, an d the armpit effect , has been 



considered to be a theoretical challenge (e.g., lAntal et al.l ( 120091 )). Never- 
theless, recent research has revealed their mechani sms, including the loose 
coup ling of altruistic trait and tag in inheritance ( jJansen and van Baalenl . 



2006), a relatively fast mutation that simultane ously changes strategy and 



tag (ITraulsen and Nowakl . 120071 ; iTraulsenl . 12008), a tag's relatively fast mu- 
tation as compar ed to the strategy ' s mutation (Antal et al. . 20091) , conflict s 
between groups (jChoi and Bowlesl . 120071 ; Garcia and van den BerghL 12011) , 



partial knowledge of oth ers' st r ategie s ( IMasuda and Ohtsukil . |2007[ ). and 



gene-culture coevolution (jlharal . 120111 ). However, indirect recipr ocity ac- 



counts for ingroup favoritism, as is relevan t to previous experiments (lYamagishi et al 



19981 . 119991 ; lYamagishi and Mifunel . 120081 ) is lacking. 



Second, in a population with group structure, individuals tend to approx- 
imate outgroup individuals' characteristics by a single value attached to the 
group. This type of stereotyp e is known as outgroup homogeneity in social 
psychology ( Jones et all Il98ll ; lOstrom and Sedikided . Il992l ; ISedikides et al. 



19981 ; iBrownl . 120001 ) . and it posits that outgroup members tend to be regarded 
to resemble each other more than they actually do. It is also reasonable from 
the viewpoint of cognitive burden of remembering each individual's proper- 
ties that humans generally resort to outgroup homogeneity. Therefore, in 
indirect reciprocity games in group structured populations, it seems to be 
natural to assume outgroup homogeneity. In other words, individuals may 
not care about or have access to personal reputations of those in different 
groups and approximate an outgroup individual's reputation by a group rep- 
utation. 

Some previous models analyzed the situations in which players do not 
have access to individuals' reputations. This is simply because it may be 
difficult for an individual in a large population to separately keep track of 
other people's reputations even if gossiping helps dissemination of informa- 
tion. This case of incomplete information has been theoretically modeled 



each interaction ( 


Nowak and Sigrni 


md. 


1998b 


a; 


Brandt anc 


Sigmund . 


2005. 


2006; 


Suzuki and Toquenaga. 


2005; 


Nakamura and Masuda. 


2011 


). However, 



these studies do not have to do with the approximation of individuals' per- 
sonal reputations by group reputations. 

By analyzing a model of an indirect reciprocity game based on group 
reputation, I provide an indirect reciprocity account for ingroup favoritism 
for the first time. In addition, through an exhaustive search, I identify all the 
different types of stable homogeneous populations that yield full cooperation 
(intragroup and intergroup cooperation) or ingroup favoritism. 



2. Methods 

2.1. Model 

2.1.1. Population structure and the donation game 

I assume that the population is composed of infinitely many groups each 
of which is of infinite size. Each player belongs to one group. 

Players are involved in a series of the donation game, which is essentially 
a type of prisoner's dilemma game. In each round, a donor and recipient are 
selected from the population in a completely random manner. Each player 
is equally likely to be selected as donor or recipient. The donor may refer to 
the recipient's reputation and select one of the two actions, cooperation (C) 
or defection (D). If the donor cooperates, the donor pays cost c > 0, and the 
recipient receives benefit b(> c). If the donor defects, the payoffs to the donor 
and recipient are equal to 0. Because the roles are asymmetric in a single 
game, the present game differs from the one-shot or standard iterated versions 
of the prisoner's dilemma game. This game is widely u sed for studying mech- 



anisms for cooperati on including indirect reciprocity ( INowak and Sigmundl . 



20051 : iNowakl . l2006al Jbf) 



Rounds are repeated a sufficient number of times with different pairs of 
donors and recipients. Because the population is infinite, no pair of players 
meet s more than once, the r eby av oi ding the possibility of dir ect reciprocity 
(e.g., Nowak and Sigmund ( 1998a ); Ohtsuki and Iwasa ( 2004 )). The payoff 



to each player is defined as the average payoff per round. 

The groups to which the donor and recipient belong are denoted by 
and g T , respectively. The simultaneously selected donor and recipient belong 
to the same group with probability r in (i.e., g& = g T ; Fig. [TJA.) and different 
groups with probability r out = 1 — r m (i.e., g$ ^ g T ; Fig. HB). 
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2.1.2. Social norms 

At the end of each round, observers assign binary reputations, good (G) 
or bad (B), to the donor and donor's group (g^) according to a given social 
norm. I consider up to so-called second-order social norms with which the 
observers assign G or B as a function of the donor's action and the reputation 
(i.e., G or B) of the recipient or recipient's group (g T ). Representative second- 
order social norms are shown in Fig. [2j Under image scoring ( "scoring" in 
Fig. an observer regards a donor's action C or D to be G or B, respec- 
tively, regardless of the recipient's reputation. In the absence of a group- 
structured population, scoring does not realize coopera tion based on indirect 
reciprocity unless certain specific c o nditions are met (INowak and Sigmund , 



1998a]: iBrandt and Sigmund I2005L 120061 : iLeimar and Hammersteinl . 12001 



Ohtsuki and Iwasal . 120041 ) . Simple standing ("standing" in Fig. [2]), and stern 



judgi ng ("judging" in Fig. [21 a l so known as Kandori) enable f ull coopera- 
tion ( ILeimar and Hammersteinl . l2001t lOhtsuki and Iwasal . 120041 ) . Shunning 
also enables full cooperation if the players' reputa t ions a re initially C and 
the number of rounds is finite (lOhtsuki and Iwasal. I2007T) or if the players' 
reputations are partially invisible (INakamura and Masudal . 1201 ll ). 

In the presence of group structure, four possible locations of the observer 
are schematically shown in Fig. [1] I call the observer belonging to g& an 
"ingroup" observer. Otherwise, the observer is called an "outgroup" observer. 

The observers can adopt different social norms for the four cases, as sum- 
marized in Fig. [TJ When the donor and recipient belong to the same group 
(Fig. [QA.), the ingroup observer uses the norm denoted by Su to update the 
donor's personal reputation. In this situation, the outgroup observer does 
not update the donor's or g d 's reputation (but see Appendix |A}. When the 
donor and recipient belong to different groups (Fig. [TB), the ingroup observer 
uses the norm denoted by s io to update the donor's personal reputation. In 
this situation, the outgroup observer uses the norm denoted by s QO to update 
g^s reputation. These four cases are explained in more detail in Sec. 12.1.41 

The distinction between sy and s io allows the ingroup observer to use a 
double standard for assessing donors. For example, a donor defecting against 
an ingroup G recipient may be regarded to be B, whereas a defection against 
an outgroup G recipient may be regarded as G. Such different assessments 
would not be allowed if sa and Si are not distinguished. 

I call Sjj, s io , and s QO subnorms. All the players are assumed to share the 
subnorms. The typical norms shown in Fig. [2] can be used as subnorms. A 



6 



subnorm is specified by assigning G or B to each combination of the donor's 
action (i.e., C or D) and recipient's reputation (i.e., G or B). Therefore, there 
are 2 4 = 16 subnorms. An entire social norm of a population consists of a 
combination of the three subnorms, and there are 16 3 = 4096 social norms. 

2.1.3. Action rule 

The action rule refers to the mapping from the recipient's reputation (i.e., 
G or B) to the donor's action (i.e., C or D). The A11C and A11D donors coop- 
erate and defect, respectively, regardless of the recipient's reputation. A dis- 
criminator (Disc) donor cooperates or defects when the recipient's reputation 
is G or B, respectively. An anti-discriminator (AntiDisc) donor cooperates 
or defects when the recipient's reputation is B or G, respectively. 

The donor is allowed to use different action rules toward ingroup and 
outgroup recipients. For example, a donor who adopts A11C and A11D to- 
ward ingroup and outgroup recipients, respectively, implements reputation- 
independent ingroup favoritism. There are 4 x 4 = 16 action rules. A donor 
refers to the recipient's personal reputation when g d = g r (Fig. [TA) and to 
g r 's group reputation when g d ^ g T (Fig. QJB). 

2.1. 4- Reputation updates 

In each round, the ingroup and outgroup observers update the donor's 
and pd's reputations, respectively. 

If gd = g T , the donor is assumed to recognize the recipient's personal rep- 
utation (Fig. An ingroup observer in this situation updates the donor's 
personal reputation on the basis of the donor's action, the recipient's per- 
sonal reputation, and subnorm Sy. An outgroup observer in this situation 
is assumed not to update g d s reputation because such an observer does not 
know the recipient's personal reputation, although the donor does. Then, the 
outgroup observer may want to refrain from evaluating the donor because the 
donor and the observer use different information about the recipient. I also 
analyzed a variant of the model in which the outgroup observer updates 
<7d's reputation in this situation. The results are roughly the same as those 
obtained for the original model (Appendix |A|) . 

If g d 7^ g T , the donor is assumed to recognize g r 's reputation, but not 
the recipient's personal reputation (Fig. [IB). An ingroup observer in this 
situation updates the donor's personal reputation on the basis of the donor's 
action, g r 's reputation, and subnorm s- 10 . Both the donor and observer refer 
to <? r 's reputation and not to the recipient's personal reputation. An outgroup 
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observer in this situation updates g^s reputation based on the donor's action, 
g T 's reputation, and subnorm s OQ . 

An out group observer knows the recipient's personal reputation if the ob- 
server and recipient are in the same group. However, the observer is assumed 
to ignore this information for two reasons. First, it is evident for the observer 
that the donor does not have access to the recipient's personal reputation. To 
explain the second reason, let us consider an outgroup observer who belongs 
to g r in a certain round. Assume that this observer assigns a new reputa- 
tion to g<i according to a subnorm different from one used when the observer 
does not belong to g r . The same observer does not belong to g T when the 
observer updates the g^s group reputation next time. This is because the 
probability that the observer belongs to g r is infinitesimally small because 
of the assumption of infinite groups. Therefore, the subnorm used when the 
observer belongs to g T is rarely used and immaterial in the present model. 

Finally, observers commit reputation assessment error. With probability 
e, ingroup and outgroup observers independently assign the reputation op- 
posite to the intended one to the donor and g<±, respectively. I introduce this 
error because G and B players must coexist in the population to distinguish 
the payoff values for different pairs of action rule and social norm (action- 
norm pair); such a distinction is necessary for the stability analysis in the 
following discussion. For simplicity, I neglect other types of error. 

2.1.5. Mutant types 

To examine the stability of an action rule under a given social norm, I 
consider two types of mutants. 

The first is a single mutant that invades a group. There are 16 — 1 = 15 
types of single mutants. A single mutant does not affect the action rule, 
norm, or reputation of the group that the mutant belongs to because of the 
assumption of infinite group size. 

The second type is a group mutant. A homogeneous group composed of 
mutants may make the mutant type stronger than the resident type. For 
example, a group composed of players who cooperate with ingroup recipients 
and defect against outgroup recipients may invade a fully cooperative popu- 
lation if any intergroup interaction (i.e., C or D) is regarded to be G under 
s OQ . By definition, a group mutant is a homogeneous group of mutants that 
is different from the resident players in either the action rule or social norm. 
I consider two varieties of group mutants, as described in Sec. [3j 
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2.2. Analysis methods 

2.2.1. Reputation scores in the equilibrium 

Consider a homogeneous resident population in which all players share 
an action-norm pair. I will examine the stability of this population against 
invasion by single and group mutants. For this purpose, I calculate the 
fraction of players with a G reputation, probability of cooperation, and payoff 
after infinitely many rounds. 

Denote by p* and p* the equilibrium probabilities that the player's and 
group's reputations are G, respectively. The self-consistent equation for p* 
is given by 

f = r in [p**§(o*) + (1 - p*)n(° m )]+r out [^$£(0 + (1 -pIWb^)} , 

(1) 

where a m and <r out are the action rules (i.e., A11C, Disc, AntiDisc, or A11D) 
that the donor adopts toward ingroup and outgroup recipients, respectively. 
$Q(cr m ) and <3>B(<7 m ) are the probabilities that the ingroup observer, based 
on Sii, assigns reputation G to a donor who has played with a G or B in- 
group recipient (i.e., g$ = g r ), respectively (Fig. [TA). Similarly $g(o" out ) and 
$B(<j out ) apply when the recipient is in a different group (i.e., ga ^ g T ) and 
the observer uses s io (Fig.[Tj3). It should be noted that $g(cr in ) and $g(cr out ), 
for example, may differ from each other even if a in = a out . Owing to the rep- 
utation assignment error, $£(a in ), $£(a in ), $£(a out ), ^(a out ) G {e, 1 - e} 
holds true. For example, if the donor is Disc toward ingroup recipients and 
subnorm Sy is scoring, $Q(<7 m ) = 1 — e and $g (o~ in ) = e. 
The self-consistent equation for p* is given by 

Pi = r>* + r out [p*$° ut K ut ) + (1 - p*)$° ut (O] , (2) 

where $Q Ut (a out ) G {e, 1 — e} and $B Ut (cr out ) e {e, 1 — e} are the probabilities 
that the outgroup observer, based on s 00 , assigns reputation G to the donor's 
group when the donor has played with a G or B outgroup recipient (i.e., 
9d 7^ 9r), respectively (Fig. HJ3). The first term on the right-hand side of 
Eq. corresponds to the fact that g^s reputation is not updated in the 
situation illustrated in Fig. [TA. 
Equations ([I]) and ([2]) lead to 

„ = r in $g(a in ) + r out fa;$g(<r out ) + (1 - p*)$g(q out )] 
P ~ 1 - r in $g(<7 in ) + r in $g(<7 in ) ^ ' 
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and 

»,OUt (TSOUt / sT-OUt \ 

v * = r B ^ > 

"g Y ^>in ^out(j)Out _|_ ^,out(J)Out ^out 

2.2.2. Stability against invasion by single mutants 

To examine the stability of the action rule (cr m , <7 out ) against invasion by 
single mutants under a given social norm, I consider a single mutant with 
action rule (cr m/ , a out '). Because the group is assumed to be infinitely large, 
a single mutant does not change the reputation of the invaded group. The 
equilibrium probability p'* that a mutant receives personal reputation G is 
given by 

p>* = r in [p*$£(<7 in/ ) + (1 - p*)^(a in, )]+r out [p*$g(<7 out ') + (1 - p*)$£(<7 out/ )] 

~ \ (5) 

When the probability that the donor and g^ have a G reputation is equal 
to p and p g , respectively, the resident donor cooperates with probability 

r i ^(a i \p)+r°^(a^\p g ), (6) 

where 

#(^p)=Kg(£) + (1-p)Cb(<t) (P = P,P g ) (7) 

is the probability that a donor with action rule a e {A11C, Disc, AntiDisc, A11D} 
cooperates when the recipient's personal or group reputation is G with prob- 
ability p. (g(&) and Cb(5") {& = o~ m or a out ) are the probabilities that a 
a donor cooperates with a G and B recipient, respectively. A11C, Disc, An- 
tiDisc, and A11D correspond to (Cg(^), Cb(^)) = (1, 1), (1, 0), (0, 1), and (0, 0), 
respectively. 

The payoff to a resident (a m , (X out )-player is given by 

7T = -c [r in ^(a in ,p*) + r out ^{a out ,p* g )} + b [r in ^{a m ,p*) + r out #(<7 out ,p*)] . 

(8) 

The payoff to a (V n/ , <x out/ ) -mutant invading the homogeneous population of 
the resident action-norm pair is given by 

tt' = -c [r in ^(a m ',p*) + r out ^(a out ',p* g )] +b [r in * (<r in , p'*) + r out *(<7 out ,p*)] . 

(9) 

If 7r > 7r' for any mutant, the pair of the action rule (<r m , <r out ) and social 
norm (sa, s io , s OQ ) is stable against invasion by single mutants. 



) 
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2.2.3. Stability against invasion by group mutants 

For a mutant group composed of players sharing an action-norm pair, 
let p'* denote the equilibrium probability that the mutant group has group 
reputation G. I obtain 

p>* = r in [p'*&£'(o-' m ') + (1 -p'*)^'(a m ')} 

+ r out [p*$£V Ut + (1 - WK ut/ )] (10) 

and 

p>* = r m p'* + r out [p*<F G u V ut ') + (1 - Pl)n ut (°° ut ')] , (11) 

where ^'(cr 111 ') or ^'(cr 111 ') is the probability that an ingroup observer as- 
signs reputation G to a mutant donor who has played with a G or B ingroup 
recipient, respectively. Even if cr m/ and a m are the same, $Q'((T m ') will be 
generally different from $Q(cr m ) because the ingroup observer in the mutant 
group may use a subnorm s„ that is different from one used in the resident 
population. Parallel definitions apply to $G'(cr out/ ) and (cx out/ ) . Equa- 
tions ([TO]) and (HU yield 

n r in $g'(cr in/ ) + r out [p*$g / ( < r out/ ) + (1 - Pg)$B / (<r out 0] 
P - 1 - r in $g'(o- in/ ) + r in $^ / (or in/ ) ^ 

and 

Pg = Pg$G , V OUt ') + (1 - P^eV^), (13) 

respectively. 

The payoff to a mutant player in the mutant group is given by 

n ' g = - c [r in ^(or in, ,p'*) +r out ^( ( x out/ ,p*)]+6 [r in *(a in, ) ^*) + r out ^(a out ,^*)] . 

(14) 

If 7r > 7Tg holds true for any group mutant player, the resident population is 
stable against invasion by group mutants. 

3. Results 

3.1. Action-norm pairs stable against invasion by single mutants 

There are 16 action rules and 16 3 = 4096 social norms, which leads to 
16 x 4096 = 65536 action-norm pairs. Because of the symmetry with re- 
spect to the swapping of G and B, I neglect action-norm pairs in which the 
action rule (i.e., A11C, Disc, AntiDisc, or A11D) toward ingroup recipients 
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is cr in = AntiDisc without loss of generality. Such an action-norm pair can 
be converted to a 111 = Disc by swapping G and B in the action rule and 
social norm. The model is also invariant if G and B group reputations are 
completely swapped in the action rule toward outgroup recipients cr out and 
subnorms Si Q and s 00 - Therefore, I can also neglect the action-norm pairs 
with cr out = AntiDisc without loss of generality. This symmetry consideration 
leaves 65536/4 = 16384 action-norm pairs (Fig. [3]). 

I exhaustively examined the stability of all 16x4096 = 65536 action-norm 



pairs . A similar exhaustive search was first conducted in (jOhtsuki and Iwasal . 



2004 ) for an indirect reciprocity game without group structure in the popula- 
tion. In the following, ir (Eq. (jSJ)) mentions the player's payoff in the resident 
population in the limit of no reputation assignment error, i.e., e — > 0. 

I first describe action rules that are stable against invasion by single 
mutants under a given social norm. I identified them using Eqs. (PO)-®. 
Under any given social norm, action rule (o~ m , o~ out ) = (A11D, A11D) is stable 
and yields tt = 0. Other action-norm pairs also yield tt = 0, but there are 
588 stable action-norm pairs with 7r > (Fig. [3]). For a given social norm, 
at most one action rule that yields a positive payoff is stable. For all 588 
solutions, the condition for stability against invasion by single mutants (i.e., 
tt > tt', where tt and tt' are given by Eqs. flSJ) and respectively) is given 
by 

br m > c. (15) 

Equation (fT5|) implies that cooperation is likely when the benefit-to-cost ratio 
is large, which is a standa rd resu l t for di fferent mechanisms of cooperation 



in social dilemma games ( iNowaki . l2006bl ). Cooperation is also likely when 



intragroup interaction is relatively more frequent than intergroup interaction 
(i.e., large r in ). 

3.2. Stability against invasion by group mutants 

The stability of these 588 action-norm pairs against invasion by group 
mutants was also examined based on Eqs. (IT0"|) -( 1T4"|) . Properly setting the va- 
riety of group mutants is not a trivial issue. At most, 65536 — 1 = 65535 types 
of group mutants that differ from the resident population in either action rule 
or social norm are possible. However, an arbitrarily selected homogeneous 
mutant group may be fragile to invasion by different single mutants into the 
mutant group. Although I do not model evolutionary dynamics, evolution 
would not allow the emergence and maintenance of such weak mutant groups. 
With this in mind, I consider two group mutation scenarios. 
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3.2.1. Scenario 1 

Single mutants may invade the resident population when Eq. ( ITS"]) is vio- 
lated. In this scenario 1, the mutants are assumed to differ from the resident 
population in the action rule, but not the social norm, for simplicity. There 
are 16 — 1 = 15 such mutants, and some of them, including (cr m , cr out ) = 
(A11D, A11D), can invade the resident population when 1 < b/c < l/r m . 
Such mutant action rules may spread to occupy a single group when Eq. ( ITS]) 
is violated. I consider the stability of the resident population against the ho- 
mogeneous groups of mutants that invade the resident population as single 
mutants when 1 < b/c < l/r in . 

Among the 588 action-norm pairs that yield 7r > 0, 440 pairs are stable 
against group mutation. Among these 440 pairs, I focus on those yielding per- 
fect intragroup cooperation, i.e., those yielding lim € ^o^/ (a m ,p*) = 1, where 
\I/ and p* are given in Sec. 12.21 For the other stable pairs, see Appendix Q5] 
This criterion is satisfied by 270 pairs (Fig. [3]). For all 270 pairs, every player 
obtains personal reputation G (i.e., lim^op* = 1), and the donor cooperates 
with ingroup recipients because the recipients have reputation G (i.e., o~ m = 
Disc). 

In all 270 pairs, sa is either standing (GBGG in shorthand notation), 
judging (GBBG), or shunning (GBBB) (refer to Fig. [2] for definitions of 
these norms). In the shorthand notation, the first, second, third, and fourth 
letters (either G or B) indicate the donor's or g&s new reputation when the 
donor cooperates with a G recipient, the donor defects against a G recipient, 
the donor cooperates with a B recipient, and the donor defects against a B 
recipient, respectively. Standing, judging, and shunning in sy are exchange- 
able for any fixed combination of cr m = Disc, a ont , s- 10 , and s OQ . Therefore, 
there are 270/3 = 90 combinations of <j out , Sj , and s OQ , which are summa- 
rized in Table [TJ An asterisk indicates an entry that can be either G or B. 
For example, GB*G indicates standing (GBGG) or judging (GBBG). The 
probability of cooperation toward outgroup recipients, payoff (tt; Eq. (JH])), 
and the probability that a group has a G reputation (p*; Eq. ([2])) are also 
shown in Table [TJ The stable action-norm pairs can be classified into three 
categories. 

• Full cooperation: Donors behave as Disc toward outgroup recipients, 
i.e., <j out = Disc and cooperate with both ingroup and outgroup recip- 
ients with probability 1. Accordingly, tt = b — c and p* = 1. 

In this case, indirect reciprocity among different groups as well as that 
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within single groups is realized. Action rule a m = <x out = Disc is stable if 
s io is either standing (GBGG), judging (GBBG), or shunning (GBBB) 
and s 00 is either standing or judging. The condition for stability against 
group mutation is the mildest one (i.e., b > c) for each action-norm 
pair. 

Under full cooperation, s io and Sj must be one that stabilizes coop- 
eration in the standa rd indirect reciproc i ty game without a group 



structured population (lOhtsuki and Iwasal . I2004J : iNowak and Sigmund 



20051 ; lOhtsuki and Iwasal . 120071 ) . The ingroup observer monitors donors' 
actions toward outgroup recipients through the use of Sj = stand- 
ing, judging, or shunning, even though ingroup players are not directly 
harmed if donors defect against outgroup recipients. The ingroup ob- 
server does so because donors' defection against outgroup recipients 
would negatively affect the group's reputation. 

Partial ingroup favoritism: Donors adopt a out = Disc and cooperate 
with ingroup recipients with probability 1 and outgroup recipients with 
probability 1/2. Accordingly, it = (b — c)(l + r m )/2 and p* g = 1/2. 

In this case, action rule a m = cr out = Disc is stable if Si G is either stand- 
ing (GBGG) or judging (GBBG), and s OQ is either scoring (GBGB) or 
shunning (GBBB). The condition for stability against group mutation 
is shown in Table |2j 

Perfect ingroup favoritism: Donors adopt cx out = A11D and always co- 
operate with ingroup recipients and never with outgroup recipients re- 
gardless of the recipient's group reputation. Accordingly, n = (b— c)r m . 

Table [1] suggests that action rule (<r m , a out ) = (Disc, A11D) can be 
stable for any subnorm s OQ . This is true because the group reputation, 
whose update rule is given by s OQ , is irrelevant in the current situation; 
the donor anyways defects against outgroup recipients. Nevertheless, 
s OQ determines s lo that is consistent with ingroup cooperation through 
the probability of a G group reputation p*. 

When s OQ = *G*G, the outgroup observer evaluates defection against 
outgroup recipients to be G (Fig. HP). Therefore, p* = 1. In this case, 
s io = *GBB, *GBG, and *GGG stabilize perfect ingroup favoritism. 
Under any of these Sj , the ingroup observer assigns G to a donor that 
defects against a recipient in a G outgroup because the second entry 
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of Si is equal to G in each case. Therefore, p* = 1, and full ingroup 
cooperation is stable. 

When s 00 = *G*B or *B*G, the outgroup observer evaluates defection 
against outgroup recipients to be G with probability 1/2. Therefore, 
p g = 1/2. In this case, Si Q = *G*G stabilizes perfect ingroup favoritism. 
Under such an s io , the ingroup observer assigns G to a donor that 
defects against a recipient in a G outgroup because the second and 
fourth entries of s io are equal to G. 

When s 00 = *B*B, the outgroup observer evaluates defection against 
outgroup recipients to be B. Therefore, p* = 0. In this case, s io = 
BB*G, BG*G, and GG*G stabilize perfect ingroup favoritism. Under 
such an Sj , the ingroup observer assigns G to a donor that defects 
against a recipient in a G outgroup because the fourth entry of s io is 
equal to G. 

In all the cases, the stability against invasion by group mutants requires 
b > c. 



3.2.2. Scenario 2 

In scenario 2 of group mutation, it is hypothesized that a group of mu- 
tants immigrates from a different population that is stable against invasion 
by single mutants. Such a group mutant may appear owing to the encounter 
of different stable cultures (i.e., action-norm pairs). The pairs that are stable 
against invasion by single mutants and yield zero payoff, such as the pop- 
ulation of A11D players, must be also included in the group mutant list. It 
should be noted that a mutant group may have a different social norm from 
that for the resident population. 

Among the 588 action-norm pairs that are stable against single mutation, 
no pair is stable against group mutation. However, 140 pairs are stable 
against group mutation for any b > c in a relaxed sense that the resident 
player's payoff is not smaller than the group mutant's payoff, i.e., n > n' g 
(Fig. [3]). The homogeneous population of each pair is neutrally invaded by 
some group mutants, i.e., 7r = 7r g . Therefore, I examine the evolutionary 
stability (e.g., iNowak 

(l2006aj )) 

against group mutation. In other words, for 
the group mutants yielding rr = n' g , I require tt > ir g when the resident players 
are replaced by group mutants. 

All 140 action-norm pairs are evolutionarily stable except that each pair 
is still neutrally invaded by their cousins. For example, four action-norm 
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pairs specified by a m = a out = Disc, s u = GB*G, s io = GB*G, s OQ = GBGG 
neutrally invade each other. These pairs yield the same payoff 7r = b — c 
and are evolutionarily stable against invasion by the other group mutants. 
Therefore, I conclude that the four pairs collectively form a set of stable 
solutions. Other sets of stable solutions consist of four or eight neutrally 
invadable action-norm pairs that yield the same payoff and differ only in Sa 
and s io . 

All 140 pairs realize perfect intragroup cooperation such that the players 
have G personal reputations and a m = Disc (Fig. [3]). Subnorm sa = GBGG 
(i.e., standing) or GBBG (i.e., judging) is exchangeable for any fixed com- 
bination of cr in = Disc, cr out , s io , and s OD . Therefore, there are 140/2 = 70 
possible combinations of <r out , S; , and s OQ , which are listed in Table [31 The 
140 pairs are a subset of the 270 pairs stable under scenario 1. The sta- 
ble sets of action-norm pairs can be classified into three categories. (1) 
Full cooperation occurs if all the subnorms are standing or judging. As al- 
ready mentioned as an example, under s OD = GBGG, the four action-norm 
pairs (a in ,a ou \s ih s io ) = (Disc, Disc, GBGG, GBGG), (Disc, Disc, GBGG, 
GBBG), (Disc, Disc, GBBG, GBGG), and (Disc, Disc, GBBG, GBBG) can 
neutrally invade each other. Similarly, if s OQ = GBBG, the same four action- 
norm pairs constitute a set realizing stable full cooperation. These two sets 
of four pairs are evolutionarily stable against invasion by each other. In to- 
tal, there are eight pairs that realize full cooperation. (2) Partial ingroup 
favoritism occurs for a set of four action-norm pairs. (3) Perfect ingroup 
favoritism occurs under the same subnorms s 00 as those for scenario 1. For a 
fixed s 00 , the same eight action-norm pairs (cr m , cr out , sa, S{ ) = (Disc, A11D, 
GB*G, *G*G) yield the same payoff 7r = (b — c)r m , can neutrally invade each 
other, and are evolutionarily stable against the other group mutants. 

3.3. When observers use simpler social norms 

In fact, players may not differentiate between the three subnorms. Players 
may use a common norm for assessing ingroup donors irrespective of the 
location of recipients. Table [T] indicates that, if s- x \ = s io is imposed for 
the resident population, but not for mutants, perfect ingroup favoritism is 
excluded. Under scenario 1, full cooperation is stable when sa = s; = 
standing, judging, or shunning and s OQ = standing or judging. Partial ingroup 
favoritism is stable when sa = Si Q = standing or judging and s 00 = scoring 
or shunning. Under scenario 2, full cooperation is stable when sy = S; = 
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standing or judging and s OQ = standing or judging. Partial ingroup favoritism 
is stable when sa = s io = standing or judging and s OQ = shunning. 

Alternatively, players may use a common norm for assessing donors play- 
ing with outgroup recipients irrespective of the location of donors. If su ^ s- lo 
is allowed and s- 10 = s OQ is imposed, partial ingroup favoritism is excluded. 
Under scenario 1, full cooperation is stable when s„ = standing, judging, or 
shunning and Si Q = s OD = standing or judging. Perfect ingroup favoritism is 
stable when sa = standing, judging, or shunning and Si Q = s OQ = *G*G. The 
results under scenario 2 differ from those under scenario 1 only in that s& = 
shunning is disallowed. 

Finally, if all the three subnorms are forced to be equal, only full coop- 
eration is stable, and the norm is standing or judging. This holds true for 
both scenarios 1 and 2. 



4. Discussion 

4-1. Summary of the results 

I identified the pairs of action rule and social norm that are stable against 
invasion by single and group mutants in the game of group-structured indirect 
reciprocity. Full cooperation (i.e., cooperation within and across groups) 
based on personal and group reputations, partial ingroup favoritism, and 
perfect ingroup favoritism are stable under different social norms. Perfect 
ingroup favoritism is attained only when the donor defects against outgroup 
recipients regardless of their reputation (i.e., <T out = A11D). Perfect ingroup 
favoritism does not occur with the combination of a donor that is ready 
to cooperate with G outgroup recipients (i.e., a ont = Disc) and a B group 
reputation. The mechanism for ingroup favoritism revealed in this study is 
distinct from those proposed previously (see Sec. [TJ. 

The major condition for either full cooperation, partial ingroup favoritism, 
and perfect ingroup favoritism, depending on the assumed social norm, is 
given by br m > c. In only 3 out of 270 social norms in scenario 1, an additional 
condition for r m is imposed (Sec. 13.2. ip . In general, different mechanisms of 
cooperation can be understood in an unified manner s uch that cooper ation 



occurs if and only if b/c is larger than a threshold value (jNowakl . l2006bl ) . For 
example, b/c must be larger than the inverse of the relatedness parameter r 
and the inverse of the discount factor in kin selection and direct reciprocity, 
respectively. The present result also fits this view; r m corresponds to r in 
the case of kin selection. 
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I assumed that players approximate personal reputations of individuals in 
other groups by group reputations (i.e., outgroup homogeneity). Adoption of 
outgroup homogeneity may be evolutionarily beneficial for players owing to 
the reduction in the cognitive burden of recognizing others' personal reputa- 
tions. Instead, the players pay potential costs of not being able to know the 
personal reputations of individuals in other groups. To explore evolutionary 
origins of group reputation, one has to examine competition between players 
using the group reputation and players not using it. It would also be nec- 
essary to introduce a parameter representing the cost of obtaining personal 
reputations of outgroup individuals. Such an analysis is warranted for future 
work. 

All the players are assumed to use the same social norm. This assumption 
may be justified for well- mixed populations but less so for populations with 
group structure because group structure implies relatively little intergroup 
communication. It seems to be more natural to assume that subnorms Sn and 
s io , which are used to evaluate actions of ingroup donors, depend on groups. 
Under scenario 2 (Sec. I3.2.2p . any stable action-norm pair is neutrally in- 
vaded by its cousins who are different in and Si Q . This result implies that 
different groups can use different norms. For example, for all the solutions 
shown in Table [3], some groups can use s„ = GBGG (i.e., standing), while 
other groups in the same population can use s io = GBBG (i.e., judging). To 
better understand the possibility of heterogeneous social norms, analyzing 
a population composed of a small number of groups, probably by different 
methods, would be helpful. 



4-2. Cooperation based on group reputation is distinct from group selection 

Indirect reciprocity based on group reputation is distinct from any type of 
group selection. This is true for both full cooperation and ingroup favoritism. 
There are two dominant variants of group selection that serve as m echanisms 
for cooperation in social dilemma games (jWest et all 120071 . 120081 ) . 

The first type is group competition, in which selection pressure acts on 
groups such that a group with a large mean payoff would replace one with a 
small mean payoff . Models with group competition induce ingroup favoritism 
(IChoi and Bowled. 120071; iGarcfa and van den Berghl . l201ll ). altruistic punish- 



ment (IBoyd et al.l . 120031 ). and evolution of the judging social norm in the 



standa rd game of ind i rect r e ciprocity whe r eby p layers interact within each 



group (jPacheco et all 120061 ; IChalub et al.l . 120061 ). In contrast, the present 
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study is not concerned with evolutionary dynamics including group compe- 
tition. The group mutant is assumed to statically compare the payoff to the 
resident group with that to the mutant group. 

The second type of group selection requires assortative reproduction in 
the sense that the offspring have a higher probability of belonging to specific 
groups than to other groups depending on the offspring's genotype . It is 



mathematically identical with kin selection (IWest et all 120071 . |2008[ ). This 
variant of group selection is also irrelevant to the present model, which is not 
concerned with the reproduction process. 

The analysis in this study is purely static. I avoided examining evolu- 
tionary dynamics for two reasons. First, the discovered mechanism for coop- 
eration may be confused with group selection in the presence of evolutionary 
dynamics. Second, the model becomes needlessly complicated. Introduc- 
ing evolutionary dynamics implies that one specifies a rule for reproduction. 
Offspring may be assumed to belong to the parent's group or to migrate to 
another group. It may then be necessary to consider the treatment of, for 
example, the heterogeneous group size. Because evolutionary dynamics are 
neglected, the present model explains neither emergence of full cooperation 
and ingroup favoritism nor the likelihood of different solutions, which is a 
main limitation of the present study. 

I stress that the concept of group mutants is introduced to sift the set of 
stable action-norm pairs. Unless group competition is assumed, the concept 
of group mutants does not particularly promote cooperation in evolutionary 
dynamics. 

4-3. Group competition can enable full cooperation and ingroup favoritism 
even if br m > c is violated 
Under a proper social norm, full cooperation or ingroup favoritism is 
stable if br m > c (i.e., Eq. ( !T5|) is satisfied) in most cases. With proba- 
bility r m , the donor, recipient, and observer are engaged in the standard 
(i.e., no group structure) indirect reciprocity game limited to a single group 
(Fig. Q]A.). In the standard indirect reciprocity game under incomplete infor- 
mation, bq > c is quite often the condition for cooperation, where q is the 
probability that the recipient's reputation is observed. This holds true when 



q indicates the observation probability for the donor ( 


Nowak and Siemund. 


1998blJal: iBrandt and Siemund. 2005. 2006: 


Suzuki and Toauenaea. 2005) or 


that for both the donor and observer f 


Nakamura and Masuda 


, 2011). Be- 



cause r m is also equal to the probability that the donor sees the recipient's 
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personal reputation, r in resembles q. In fact, replacing r m by q in Eq. (1151) 
yields bq > c. 

If a player is capable of recognizing the personal reputation of a fixed num- 
ber of others, the maximum population size for which indirect reciprocity is 
possible in the standard indirect reciprocity game scales as l/q. The con- 
sistency between Eq. (fT5"j) and bq > c implies that the concept of group 
reputation does not increase the maximum population size for which indirect 
reciprocity occurs. However, under group competition (Sec. I4.2p . full coop- 
eration and ingroup favoritism can be stable even if the restriction imposed 
by Eq. (|T5j) is removed. 

To explain this point, assume that the population is subjected to evolu- 
tionary dynamics such that players with relatively large payoffs would bear 
more offspring in the same group and group competition occurs. The rate of 
group competition is denoted by l/t gc , where t gc is the mean time interval 
between successive group competition events. Emergence of a single mutant 
occurs with rate l/t m . Selection and reproduction of single players occur 
with rate l/t s . 

If Eq. f[T5"l) is violated, single mutants emerge in time oc t m . Then, some 
types of mutants, including the A11D mutant, spread in the invaded group in 
time oc t s under scenario 1 of group mutation. The invaded group presumably 
possesses a smaller group-averaged payoff than other resident groups because 
the resident population is stable against invasion by group mutants as long 
as b > c, in all but three of 270 action-norm pairs (Table [2]). If l/t gc ^> l/t m , 
such an invaded group is likely to be eradicated by group competition because 
group competition occurs much faster than the emergence of single mutants. 
In this case, full cooperation or ingroup favoritism, depending on the given 
social norm, can be maintained in the absence of Eq. ffTBT) . This discussion 
does not involve timescale t s . 

Group competition is needed to remove Eq. (TT5|) . If Eq. (Tl5|) is imposed, 
cooperation occurs without group competition. 

4-4- Relationship to previous behavioral experiments 

In this section, I discuss possible linkages between the present model 
and the previous experiments examining indirect reciprocity and third-party 
punishments. 

Yamagishi and colleagues conducted a series of laborator y experiments to 



show that ingroup favoritism is induced by a group heuristic (lYamagishi et al. 
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19981 . Il999l ; lYamagishi and Mifund . 120081 ) . With a group heuristic, donors co- 



operate with ingroup recipients because the donors expect repayment from 
other ingroup players. Donors do not use the information about others' rep- 
utations in these experiments. In contrast, players use personal reputations 
of ingroup members in the present model. Nevertheless, the previous exper- 
iments and the current model do not contradict each other. 

In another laboratory experiment, Mifune et al. showed that presentation 
of eye-like painting p romotes donor's coo peration toward ingroup recipients 
in the dictator game (IMifune et all 120101 ) . For expository purposes, I define 
serious subnorm to be either standing, judging, or shunning. If the eye- 
like painting approximates an ingroup observer obeying a serious subnorm, 
this experimental result is consistent with the present theory because ingroup 
cooperation is theoretically stable when the ingroup observer adopts a serious 
subnorm. Because t he painting does no t increase the cooperation toward 



out group recipients ( Mifune et al. . 2010l ). it may not turn s io to a serious 



subnorm for some psychological reason. Humans may use double standards, 
i.e., Sii 7^ S[ , which favor ingroup favoritism in my model. 

Other behavioral experiments have addressed the relat ionship between 



third - party altruistic puni shments and ingroup favoritism (IBernhard et al. 



20061 ; IShinada et all 12004 ) . In precise terms, third-party punishments and 



reputation-base d indir e ct reciprocity are dist inct mechanisms for cooperation 
(ISigmund et all l200ll ; lOhtsuki et all 120091 ) . Nevertheless, below I discuss 
possible linkages between these experiments and my model. 



In indigenous communities in Papua New Guinea (IBernhard et all 120061 ). 



the amount of punishment is larger if the punisher belongs to the donor's 
group than to a different group (compare ABC and AB cases in their Fig. 
1). Their results suggest that the ingroup observer may use a serious subnorm 
and the outgroup observer may not. Furthermore, given that the punisher 
is in the donor's group, the amount of punishment is larger if the donor and 
recipient belong to the same group (Fig. [TA, if the punisher is identified 
with the ingroup observer) than if they belong to different groups (Fi g. [TB; 
compare the ABC and AC cases in Fig. 1 of IBernhard et al. d2006h ). In 
this situation, the ingroup observer may use a serious subnorm sa when the 
donor plays with ingroup recipients (Fig. [TA) and use a nonserious subnorm 
s io when the donor plays with outgroup recipients (Fig. (IB). My model re- 
produces ingroup favoritism under these conditions. 

However, my mode l and others are not concerned with a main finding in 
(IBernhard et all 120061 ) that the amount of punishment is larger when the 
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punisher and recipient belong to the same group. For the reasons stated in 
Sec. I2.1.4| I did not assume that observers make their judgments differently 
when they belong to the recipient's gro up q r and to a differen t group. To 
theoretically explain the main finding in iBernhard et al.l (120061 ) . one should 
explicitly analyze the case of a finite number of groups. 

In different laboratory experiments, the amount of punishment is larger 



for an ingroup donor's defection than an outgroup donor's defection (IShinada et al. 



20041 ). My results are consistent with their results in that, for ingroup fa- 
voritism, the donor's action must be seriously evaluated by the ingroup ob- 
server using Si; and not seriously by the outgroup observer using s 00 - 

4-5. Reduction of ingroup favoritism 

Although ingroup favoritism seems to be a canonical behavior of hu- 
mans, reduction of in group bias would induc e intergroup cooperation and 
is socially preferable (lYamagishi et al. I, [l998|). Full cooperation is Pareto 
efficient, whereas ingroup favoritism is not. Various psychological and so- 
ciological mechanisms for reducing the ingroup bias, such as guilt, "auto- 
motive" control, retraining, empathy, and decategorization have been p ro- 



posed ( jHewstone et al.l . l2002t iDovidio et al.l . l2005t ISedikides et al.l . Il998l ) . 



My results provide theory-based possibilities of reducing ingroup bias. 
First, if the social norm is fixed, conversion from ingroup favoritism to full 
cooperation is theoretically impossible because full cooperation and ingroup 
favoritism do not coexist under a given social norm. Therefore, advising 
players to change their behavior toward outgroup recipients from A11D to Disc 
is not recommended unless the social norm is also altered. Conversion from 
ingroup favoritism to full cooperation requires a change in the social norm 
such that players as observers seriously assess ingroup donors' actions toward 
outgroup recipients (with s io ) and outgroup-outgroup interaction (with s OQ ). 
In particular, if s- lo is a serious subnorm, perfect ingroup favoritism with no 
intergroup cooperation disappears (Sec. 13 .3 j) . 

Second, if the three subnorms are the same, the perfect and partial in- 
group favoritism is eradicated. The coincidence of only two subnorms is in- 
sufficient to induce full cooperation (Sec. 13 .3j) . The subnorms Sa = s io = s OQ 
that exclude the ingroup bias and realize full cooperation are standing or 
judging. Therefore, without speaking of serious subnorms, forcing players to 
use the same subnorms consistently in assessing donors in different situations 
may be also effective in inducing full cooperation. 
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Ingroup favoritism has been mostly an experimental question except for 
some recent theoretical studies. This study is a first step toward under- 
standing and even manipulating the dichotomy between full cooperation and 
ingroup favoritism in the context of indirect reciprocity. 
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Appendix A: A variant of the model with different reputation dy- 
namics 

In this section, I analyze a variant of the model in which outgroup ob- 
servers update the group reputation of donors involved in ingroup interaction 
(i.e., g d = g r ). 

Reputation dynamics 

I assume that the outgroup observer uses the donor's action, the recipi- 
ent's personal reputation, and s OD , to update g^s (not the donor's personal) 
reputation. 

The equivalent of Eq. (j2J) under this reputation update rule is given by 

p* = r in [p*$£f(a in ) + (1 (a in )]+r out [p*$£ ut ((7 out ) + (1 -p*)$bV 

(16) 

I obtain p* and p* by solving the set of linear equations ([Q) and ([To]) . Equa- 
tions (15|- (|T0|) . and (|T2|) are unchanged. As compared to the case of the 
original reputation update rule (original case for short), Eq. ( ITT]) is replaced 
by 

p>* = r in [p'^V 11 ') + (1 -p'*)$b V n ')] 

+ r out [p*$° u V out/ ) + (1 - j9*)$ B ut ((x out/ )] • (17) 

The equivalent of Eq. f lT3|) is obtained by substituting Eq. ffl~2]) in Eq. f|T7|) . 

Because of the symmetry with respect to G and B, I exclude action rules 
having a m = AntiDisc from the exhaustive search, as I did in the original 
case (Sec. 13. ip . It should be noted that one cannot eliminate action-norm 
pairs with <7 out = AntiDisc on the basis of symmetry consideration, which is 
different from the original case. This is because a player's personal and group 
reputations are interrelated through the behavior of the outgroup observer 
when g d = g T . 

Results 

Under the modified reputation update rule, there are 725 action-norm 
pairs that are stable against invasion by single mutants and yield 7r > 0. 

Under scenario 1, 507 out of the 725 pairs are stable against group mu- 
tation, and 324 out of the 507 pairs yield perfect ingroup cooperation. The 
324 action-norm pairs are classified as follows. First, 68 pairs yield full co- 
operation with either (a m ,a ont ) = (Disc, Disc) or (Disc, AntiDisc). Second, 
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14 pairs yield partial ingroup favoritism with (<7 in ,<T out ) = (Disc, AntiDisc). 
Third, 236 pairs yield perfect ingroup favoritism with (cr m , <j out ) = (Disc, 
A11D). Fourth, 6 pairs yield perfect ingroup favoritism with (er in ,cr out ) = 
(Disc, AntiDisc). 

As in the original case, a m = Disc, and sa is either standing, judging, 
or shunning for these pairs. In contrast to the original case, (o~ m , a out ) = 
(Disc, AntiDisc) can be stable, yield perfect ingroup cooperation, and even 
yield outgroup cooperation, under some social norms. In such a situation, 
the values of the personal and group reputations (i.e., G and B) have op- 
posite meanings. In other words, a G but not B personal reputation elicits 
intragroup cooperation, while a B but not G group reputation elicits inter- 
group cooperation. Therefore, action rule (cr in , <7 out ) = (Disc, AntiDisc) in 
this situation can be regarded as a relative of (<r in , cr out ) = (Disc, Disc) in the 
situation in which the values of the personal and group reputations have the 
same meaning. On this basis, I consider that the present results are similar 
to those obtained for the original case (Tabled]). In particular, only full co- 
operation is stable under standing or judging if sa, s io , and s OQ are assumed 
to be the same. 

Under scenario 2, 144 out of 725 pairs are stable against group mutation, 
and all of them yield perfect ingroup cooperation. The 140 pairs that survive 
in the original case (Sec. 13.2.21) also survive under the modified reputation 
update rule. The action rule in the additional four (= 144 — 140) pairs is 
(<7 in ,cr out ) = (Disc, AntiDisc). Another difference from the original case is 
that the action-norm pairs that yield partial ingroup favoritism in Table [3] 
realize full cooperation in the present case. Otherwise, the results are the 
same as those in the original case. In summary, 16 pairs realize full coop- 
eration, and 128 pairs realize perfect ingroup favoritism. As is the case for 
scenario 1, only full cooperation is stable with standing or judging if the three 
subnorms are assumed to be the same. 

Appendix B: The rest of the stable action-norm pairs under sce- 
nario 1 

Under sceinario 1 in the original case, 270 out of 440 stable action-norm 
pairs with a positive payoff realize perfect intragroup cooperation (Sec. l3.2.Tj) . 
The other 170 stable action-norm pairs yielding n > are summarized in 
Table HI For all the stable action-norm pairs shown, a m = Disc. Table H] 
indicates that outgroup favoritism does not occur. 
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There are 18 rows in Table HI For the two action-norm pairs shown in 
the first row, the stability condition is given by br m > c and r in < 1/2. For 
the two action-norm pairs shown in the sixth row, the stability condition is 
given by br m > c and r m > a/2 — 1 . For the four action-norm pairs shown in 
the sixteenth row, the stability condition is given by b/c > (1 +r m )/r in . For 
all the other action-norm pairs, the stability condition is given by br m > c. 
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£ assigns G/B to £ using Sy, 
does nothing 




' assigns G/B to fusing 5 i0 

assigns G/B to gd using Soo 



i : donor 



recipient 



: ingroup observer 
: outgroup observer 



Figure 1: Schematic representation of ingroup and outgroup observers. In A, the donor's 
group gd and the recipient's group g T are identical. This event occurs with probability r ln . 
In B, gd 7^ g T . This event occurs with probability r out = 1 — r m . 
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Scoring 




Standing 




G B 




G B 
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G G 
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G G 
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B B 
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B G 




Judging 




Shunning 




G B 




G B 
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G B 
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G B 


D 


B G 
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B B 



Figure 2: Typical second-order social norms. The rows outside the boxes represent the 
donor's actions (C or D), and the columns represent the recipient's reputations (G or B). 
The entries inside the boxes represent the reputations that the observer assigns to the 
donor in each case. 
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65536 action-norm pairs in total 

symmetry consideration 



stable against single mutants 
and positive payoff 



scenario 1 



16384 pairs 
588 pairs 

A, A, SI 

440 pairs 140 pairs 

perfect ingroup cooperation 



scenario 2 



stable against 
group mutants 



stable against group mutants 
in a relaxed sense) 



4r 



270 pairs 



4r 



140 pairs 



Figure 3: Procedure for obtaining the stable action-norm pairs with perfect ingroup co- 
operation shown in Tables [I] and [3] 



33 



Table 1: Stable action-norm pairs with perfect ingroup cooperation under scenario 1. 
The probability of cooperation with outgroup recipients, 7r, and p* are the values in the 
limit e -» 0. su = GBGG (standing), GBBG (judging), or GBBB (shunning). Action- 
norm pairs only different in su were distinguished when counting the number of stable 
action-norm pairs. An asterisk indicates that both G and B apply. 



State 


Prob. C to 
outgroup 


7T 


^out 


P* g 


Social norm 

(Sio-Soo) 


No. 
pairs 


Full cooperation 


1 


b-c 


Disc 


1 


GB*G-GB*G 
GBBB-GB*G 


18 


Partial ingroup 
favoritism 


l 

2 


(6-c)(l+r in ) 
2 


Disc 


i 

2 


GB*G-GB*B 


12 


Perfect ingroup 
favoritism 





(b - c)r in 


AMD 


1 


*GBB-*G*G 
*GBG-*G*G 
*GGG~*G*G 


72 


1 
2 


*G*G-*G*B 
*G*G-*B*G 


96 





BB*G-*B*B 
BG*G-*B*B 
GG*G-*B*B 


72 



Table 2: Conditions for stability of partial ingroup favoritism against group mutation 
under scenario 1. The condition on r m is required for the three out of 12 social norms to 
prevent the invasion by group mutants that defect against ingroup recipients and cooperate 
with outgroup recipients. 



Conditions 


Social norm 


Social norm 

(^io~ ^oo) 


No. 
pairs 


b > c 


GBGG, GBBG, or GBBB 


GBBG-GBBB 
GBGG GBBB 
GBBG-GBGB 


9 


b> c and r in > y/2 — 1 


GBGG 


GBGG— GBGB 


1 


b> c and r m > 1/2 


GBBG or GBBB 


GBGG-GBGB 


2 



Table 3: Stable action-norm pairs with perfect ingroup cooperation under scenario 2. sa = 
GBGG (standing) or GBBG (judging). Different action-norm pairs in the same row are 
neutrally invadable to each other. An asterisk indicates either G or B. 



State 


Prob. C to 
outgroup 


TT 


a out 


P* s 


Social norm 

(Sk>~ ^oo) 


No. 
pairs 


Full cooperation 


1 


b — c 


Disc 


1 


GB*G-GBGG 
GB*G-GBBG 


8 


Partial ingroup 
favoritism 


l 

2 


(6-c)(l+r in ) 
2 


Disc 


i 

2 


GB*G-GBBB 


4 


Perfect ingroup 
favoritism 





(b - c)r in 


AUD 


1 


*G*G-BGBG 
*G*G-GGBG 
*G*G-BGGG 
*G*G-GGGG 


32 


1 
2 


*G*G-BGBB 
*G*G-GGBB 
*G*G-BGGB 
*G*G-GGGB 
*G*G-BBBG 
*G*G-GBBG 
*G*G-BBGG 
*G*G GBGG 


64 





*G*G-BBBB 
*G*G-GBBB 
*G*G-BBGB 
*G*G-GBGB 


32 



Table 4: Stable action-norm pairs with a positive probability of cooperation that are not 
included in Table [U s u = GBGG (standing), GBBG (judging), or GBBB (shunning). An 
asterisk indicates either G or B. The sixth and seventh rows in the table are not aggregated 
because the stability condition is different between these cases (Appendix iBj) . 



Prob. C to 
ingroup 


Prob. C to 
outgroup 


71 


cr out 


p* 


Pi 


Social norm 


No. 
pairs 


l 

2 


l 

2 


b-c 
2 


Disc 


l 

2 


1 

2 


GBBB-GBBB-GB*B 


2 


1 
2 





(b-c)r in 
2 


A11D 


1 

2 


1 

2 


GBBB *GBB-*G*B 
GBBB-BB*G-*G*B 
GBBB-*GBB-*B*G 
GBBB BB*G-*B*G 


32 


l+r in 


1 

2 


(6-c)(l+(r in ) 2 ) 


Disc 


l+r in 


1 

2 


GB*G-GBBB-GBGB 
GB*G-GBBB-GBBB 


4 


2 


2 


2 


l+r in 





(6-c)r in (l+r in ) 


A11D 


l+r in 


1 

2 


GB*G *GBB *G*B 
GB*G-BB*G-*G*B 
GB*G-*GBB-*B*G 
GB*G BB*G *B*G 


64 


2 


2 


2 







(b- c)(r in ) 2 


A11D 




1 


GB*G BBBB-*G*G 
GB*G BB*G *G*G 


68 


1 

2 


GB*G BBBB *G*B 
GB*G BBBB *B*G 


Disc 
A11D 





GB*G-GBBB-BB*B 
GB*G-BBBB-*B*B 
GB*G *GBB *B*B 



